ADIABATIC LIMIT OF THE ETA INVARIANT OVER COFINITE 

QUOTIENT OF PSL(2,M) 
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Abstract. We study the adiabatic limit of the eta invariant of the Dirac operator over 
cofinite quotient of PSL(2,R), which is a noncompact manifold with a nonexact fibred-cusp 
metric near the ends. 



1. Introduction 

The eta invariant of a Dirac operator was introduced in the seminal paper [2] as the 
boundary correction term in the Atiyah-Patodi-Singer index formula. Since the paper of 
Atiyah et al. [2] , the eta invariant has found a place in many branches of mathematics. One 
particular aspect of the eta invariant which has found fruitful applications is the study of 
the adiabatic limit of the eta invariant, in which the eta invariant on the total space of a 
fibration is investigated when the fiber is collapsed. This was initiated by Witten [27] and 
later proved independently by Bismut and Freed [5] and Cheeger [8] . Expanding on the earlier 
work of O [HI [27] , Bismut and Cheeger [7] and then Dai [9] studied the adiabatic limit for a 
general fibration of compact manifolds. We also refer to the recent work of Moroianu [21] . 
who analyzed the adiabatic limit for general families of first order elliptic operators from the 
view point of the calculus of adiabatic pseudodifferential operators. 

In this paper we study the spectral properties of the Dirac operator and compute the 
adiabatic limit of its eta invariant on a certain three-dimensional noncompact manifold X, 
which is given by a cofinite quotient of PSL(2,]R). Then X is a circle bundle that fibers over 
a non- compact Riemann surface S with cusps, 

(1-1) 51 -X 



where g, k denote the genus and the number of cusps, respectively, of the base Riemann surface 
which has finite volume. There has been much interest in more general spectral problems for 
the case when the fibers are circles over compact bases [U [U [TOl [13 [22l [23l [25l [29]. However, 
in all these papers the base manifold is compact. In this paper we consider the spectral 
properties and the eta invariant in the case when the base is not compact. 

Replacing the circle in (II. ip with a circle of radius r, then choosing a spin structure, 
we denote the corresponding Dirac operator by Dr- The first purpose of this paper is to 
study the spectral properties of Dr defined by non-exact fibred cusp metrics near the ends. 
In particular, we analyze the dependence of the continuous spectrum of Dr on the choice of 
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spin structure. Postponing terminology concerning trivial spin structures to Section 2, we 
can now state our first result: 

Theorem 1.1. With denoting the number of ends with trivial spin structures, the continu- 
ous spectrum of the Dirac operator D^. consists of -copies of countahly many families given 
by 

( -oo, - |m| (1 + '/'][j[-L + \m\{l + r~') +oo ) 

indexed by odd integers m £ 1 + 2Z if the spin structure along the -fiber is trivial, or by 
even integers m G 2Z otherwise. 

This theorem can be regarded as a generalization of the result of Bar in to the fibred 
cusp case where the continuous spectrum of Dr depends on the spin structures of the S^-fibers 
and of the cross sections of the base manifold S^^^ near the ends. Another novelty of this 
theorem is that the Riemannian metric over the cusps are not exact fibred cusp metrics, which 
have been extensively studied in, for example, [HI [T71 [26] . It is because of the non-exact fibred 
cusp metrics that the continuous spectrum of Dr is quite complicated. 

The second main result of this paper is the adiabatic limit of the eta invariant of Dr as 
the fiber is collapsed (that is, r — > 0). As we observed in Theorem 11.1^ the Dirac operator 
Dr has continuous spectrum as well as discrete spectrum; moreover, the corresponding odd 
heat kernel of Df. is not trace class. Therefore, the standard definition of the eta function 
using the eigenvalues or the trace of the odd heat kernel are not valid in our situation. This 
requires us to define a "regularized" eta invariant, which is reminiscent of the b-eta invariant 
of Melrose [20] and similar to a regularized eta invariant used by Park [2l] to analyze eta 
invariants on hyperbolic manifolds with cusps. With rj{Dr, s) denoting the eta function of Dr 
defined through a regularized trace similar to Melrose's fe-trace |20j (see Definition in ()4.5p ). 
the following is our main result: 

Theorem 1.2. We assume that the spin structure along the -fiber is trivial. 

(1) For sufficiently small r > 0, i]{Dr, s) defined for 3f?(s) ^ has a meromorphic exten- 
sion over C and may have a double pole at s = 1 and simple poles on — N U {0,2}. 
Moreover, for a totally nontrivial spin structure, r]{Dr,s) may have only simple poles 
at -NU {0,1,2}. 

(2) For the eta invariant, 

ri{Dr) := Regg^Qr]{Dr,s) 
where Reg^^o means to take the regular value at s = 0, the following equality holds: 

(1.2) lim n{Dr) = --i-Vol(5],,.) = i (2 - 2^ - 

where Vol(Sg^K) is given w.r.t. the Poincare metric. 

For the compact case, and for the trivial spin structure, a result corresponding to the 
formula ()1.2p in Theorem 11.21 was proved by Seade and Steer [25] , who also obtained the 
original value of the eta invariant by applying the APS index formula for a manifold with 
smooth boundary. In our noncompact case, obtaining the original value of the eta invariant 
will require an index formula for manifolds whose boundaries are manifolds with non-exact 
fibred cusp ends. This problem will be considered elsewhere. 

The paper is organized as follows. In Section [5] we develop the required background ma- 
terial, including a discussion of spin structures and the Dirac operator Dr. In Section [3] we 
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analyze the Dirac operator in terms of the fibred cusp calculus of Mazzeo-Melrose [19] and 
we prove Theorem 11.11 In Section |4] we define the regularized eta invariant and in Sections 
O m and [7] we analyze the geometric and spectral sides of the Selberg trace formula in our 
context, which will be used to prove Theorem 11.21 

2. DiRAC OPERATOR AND SPIN STRUCTURE 

In this section, we define the Dirac operator over the cofinite quotient of PSL(2,M) by 
a discrete subgroup. Equivalently we consider the Lie group G = SL(2, M) and a discrete 
subgroup r C G containing {±1}, so that the quotient r\G is the same as the quotient 
(r/{±l})\PSL(2,M). 

For r G (0, oo) we define a family of metrics gr over G such that the left translations of 
E := r~^G, A, H are orthonormal w.r.t. Qr where C, A,H is a. basis of g = sl(2,]R) given by 

(-) 

Recall that the corresponding Levi-Civita connection is determined by the Koszul formula 

25,(Viy, Z) = Xgr{Y, Z) + Ygr{Z, X) - Zgr{X, Y) 

+ gri[X, Y],Z)- gr{[X, Z],Y) - gr{[Y, Z],X) 

where X, Y, Z denote vector fields over G. 

Since G is topologically the same as x 7i where 7i is the Poincare upper half plane, 
there are two spin structures on G. We choose the one determined by the left invariant 
trivialization. Denoting the lifted connection to spinor bundle by the same notation V^, we 
define the Dirac operator by 

Dr := E.V'e + A-'^A + H.Vh 

where X. denotes the Clifford action by X. By a straightforward computation as in [13], [25], 
we obtain 

Dr^P = \{^-2)G.A.H.i: 

for a basic spinor ip. 

We twist Dr by multiplying the volume element lo := E.A.H. to define D^., that is, 

br := E.A.H.Dr, 
which has the following simplified form, 

'2-r2^ 



Dri. = (^) ^ 



for a basic spinor ip. The Clifford algebra generated by E, A, H has the Pauli matrix repre- 
sentation given by 



Then we have 
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From these, for any spinor aipi + (31^2 with basic spinors V'l) "02 and smooth functions a, (3 on 
G, we have the following representation of Dy.-, 

Now we let 

Z := -iC, 2X+ := A- iH, 2X_ ■.= A + iH 
(Our convention is slightly different from the one in [25]). Then they satisfy 
[Z, X+] = 2X+, [Z, X_] = -2X_, X_] = Z, 

and we have 

5. = (^) + ("2X -^^^z) C^{G)®C^{G). 
It is also easy to check that 

?.2 [-{A^ + H^ + r-^C^) \ , 

(2.3) D^ = \ Q _(^2 _^ jj2 _^ r-^C^) ) + ^ terms, 

hence the Dirac Laplacian is a generalized Laplacian whose principal symbol is given by 
the metric gr- 

To define the Dirac operator over X = r\G, let us discuss on the spin structures on 
X = r\G, which will play a crucial role throughout this paper. First recall that there are 
\H^{X, Z2)|-number of spin structures over X since every 3-dimensional manifold is spin. This 
can be understood from the following diagram. 



X X 

where 5,5 are the Spin bundles over the universal covering manifold X and X respec- 
tively. Since S = X x Spin(3) and 5 = 7r*5, the possible Spin bundle 5 is given by the 
Z2-representation p of t^i{X) as follows: 

(2.4) 5p = X XpSpin(3) 

with the obvious Z2-action to Spin(3). Therefore, each Z2-representation of t^i{X) provides 
us with inequivalent spin structure on X. Recall 

TTiiX) = [xi,yi,hj,k I 1 < i < 5, 1 < J < K, 

g K 

i=l j=l 

where g, k denote the number of genus and cusps of the base Riemann surface S^^^ of the 
fibration pTT]) . 

Among spin structures, there are spin structures which are determined by those Z2- 
representations p of t^i^X) with p{hj) = — 1 for some j. Such a spin structure over Riemann 
surface ^g,K is called nontrivial along the cusp corresponding to j in [3]. Following [3], we 
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call such a spin structure nontrivial along the cusp if p{hj) = —1 for the corresponding j, and 
totally nontrivial spin structure if it is determined by a Z2-representation p with 

(2.5) p{hj) = -1 for all i = 1, . . . , k. 

From the relation of the generators of tti{X), there is the following obstruction for this, 

K 

llpih,) = l. 

i=i 

Hence, in this case, the number of cusps k should be even. We distinguish two classes of spin 
structures according to (non)triviality of spin structure along the fiber S^/jitl}. We call the 
spin structure trivial along the fiber if the spin structure is trivial along the fiber S^/{±1} 
(or equivalently, if the representation p maps the generator k to 1), and nontrivial along the 
fiber otherwise. Note that if the spin structure is trivial along the S'^/{ibl}-fiber, this spin 
structure does not extend to a spin structure over the disc bundle over Yjq ^. From the above 
discussion we have 

Proposition 2.1. There are spin structures over X = T\G. There exist totally non- 

trivial spin structures over X if and only if k is even. 

For the trivial representation of Tri{X), the resulting Spin bundle denoted by Si is topo- 
logically trivial, determined by the left invariant trivialization over X = T\G. The associ- 
ated spinor bundle Si = Si Xgpj^(3) 11(3) (where S(3) = is the spinor representation of 
Spin(3) = SU(2)) is therefore also trivial and has the following relation with other Sp, 

where Cp — > X is the flat line bundle associated to p. 

From the definition of Dr over G and the equality (|2.4|) , we can see that the induced Dirac 
operator from Dj. pushed down to X has the following form, 

(2.6) Dr = [^^) + (^^'^'^^ ^^^i^ acting on C^{T\G,x) 

where C^(r\G, x) [x = P ® p) consists of the smooth functions with co-compact supports 
such that fijx) = x{l)f{x) for 7 G ■ki{X), x £ G. We also denote the L^-completion of Dr 
(w.r.t. certain metric metric explained in (j4.ip ) by Dr, that is, 

(2.7) Dr : L\T\G,x) ^ L^ir\G,x). 

3. Analysis of fibred cusp operators 

In this section we show that the metrics gr are of conformal fibred cusp type. Consequently, 
we show that the Dirac operators Dr belong to the class of weighted fibred cusp operators 
introduced by Mazzeo and Melrose [19], and we prove Theorem II .![ 

First we introduce some subgroups of G = SL(2,]R), 



(3.1) iVo 



1 X 
1 



X GRyA, 



62 





cos U sm f 
- sin 9 cos / 



Then the standard parabolic subgroup Pq is given by NqAqZ where Z = {±1} C K and any 
parabolic subgroup P of G is conjugate to Pq by an element kp in K. A parabolic subgroup P 
has a decomposition P = NpAZ where Np is the derived group of P and A is any conjugate 
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of ^0 ill to be called a Cartan subgroup. It is clear that is the unique Cartan subgroup 
Pq with Lie algebra orthogonal to that of K. Therefore, P has a unique Cartan subgroup 
with the same property. From now on, we assume that the pair (P, A) satisfies this condition. 
For such a pair (P, A) with N = Np, we have the Iwasawa decomposition G = NAK. 

For a given F C G, a parabolic subgroup P of G is called V -cuspidal \i N = Np contains a 
nontrivial element of F. As one knows, the finitely many ends oi X = V\G are parametrized 
by F-conjugacy classes {P}r = {7^7"^ | 7 € F/Fp} where Fp := FnP. Let P be a F-cuspidal 
parabolic subgroup of G corresponding to one end oi X = T\G. This subgroup determines a 
cusp cp, an incomplete manifold which is identified with a neighborhood of the cuspidal end 
of the quotient Fp\G. 

Assume first that P = Pq is the standard parabolic subgroup of G. The manifold Fp\G 
has two commuting free actions: the action of K to the right and that of Tn^\Nq to the 
left where F^Tq := F n Nq. The first action exists in fact globally on X = F\G, while the 



By projection on the last two terms, we view this as the total space of a fibration with fiber 
S^. Note that this fibration makes sense only near the end and is not the fibration in (II. ip 
where the roles of two S^'s are reversed. 

As seen above, the spinor bundle corresponding to the representation p is the spinor bundle 
for the trivial representation, twisted by the flat line bundle Cp defined by p. The Dirac 
operator on G has been computed in (12. 6p with respect to the orthonormal vector fields 
r~^G, A, H defined in (j2.ip and the representation x- The same expression holds on the 
spinor bundle on the cusp Fp\G, where the vector fields r~^G, A, H now act on Sp. There 
is no ambiguity about the action of these vector fields since the twisting bundle Cp is flat. 

Litroduce the function v := e"" on the cusp and glue the "boundary at infinity" M/ZZx {;/ = 
0} X IR/27rM to the cusp, thus getting a manifold with boundary Fp\G. The /S^-fibration 
structures extend to the boundary. We will show that for each fixed r, the metric gr on X is 
conformal to a fibred cusp metric (with respect to the fibration of the boundary induced from 
the F7Vq\A''o action). In the coordinates (x,z^ = e~'^,9) of Fp\G, the coefficients of a matrix 




is identified with R/lZxRx M/27rM by the map 



(3.2) 





are given by the inverse of the map (j3.2p : 



ac + hd 





X = 



c2 + 



We compute then 



E 



r ^df 



(3.3) 



A 



cos 2680 + 2u~^ cos 298^ - 2iy sin 20di 



H 



sin 20di 



'e 



2i/"^sin26ia 



'x 



2u cos 268, 
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These equalities also can be found at p. 52 of [12] or p. 115 of [15j. It follows that in the 
coordinates (x, 6) the metric Qt is given by 

-^dv^ + ^dx^ + r'^{de + ^dxf , 
4z/^ 4 z 

thus 



This is what is called a fibred cusp metric, or a smooth metric on the fibred cusp tangent 
bundle. To define this, consider the subalgebra *V of the Lie algebra V of smooth vector fields 
on the manifold with boundary Tp\G, spanned over C°^{Tp\G) by the vector fields 

:= u^du, Vg := ude, K := da:- 



This sub-algebra is by definition a free C°°(rp\G)-module so it is the space of sections of a 
smooth vector bundle over C°°(rp\G); this vector bundle, called *rrp\G, comes equipped 
with a bundle morphism to the usual tangent bundle TTp\G, induced from the inclusion of 
the spaces of sections *V V, which is an isomorphism over Tp\G. 

Since *V is a Lie algebra and the metric defined above is non-degenerate and smooth on 
fibred cusp vector fields, it follows immediately from the Cartan formula that the Levi-Civita 
connection on Tp\G with respect to the metric extends to the boundary in the sense that 
for every Vi,Vj,Vk S *V, we have 



{Vvyj,Vk)eG°-{Tp\G). 

The spinor bundle Sp extends over the boundary, such that the Clifford multiplication by Vi 
is a smooth map. Take now the orthonormal frame 

Vi := V2 := - Ve/2, V3 := ^Vg. 

2r 

Its relationship to the global frame {E,A,H) is deduced from (j3.3p : 

Vi=- ^(sin 26 A + cos 29H) 

(3.4) ^2 = ^ (cos 29 A - sin 29 H) 

Denote by y a local lift to the spinor bundle of the orthonormal frame (Vi, V3, V2). Let 
£7 : Tp\G — > S(3) be a smooth map into the 3-spinor representation space. It follows from 
the local formula 

(3.5) »=i \ j<k 

that the Dirac operator with respect to g$ (defined first on compactly supported spinors over 
Tp\G) extends to smooth spinors up to the boundary. Such an operator, a combination of 
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fibred cusp vector fields and of smooth bundle endomorphisms down to the boundary {i^ = 0}, 
is called a fibred cusp differential operator. Thus 

G Diffi(r>\G,Sp). 

The Dirac operator changes very nicely with respect to conformal changes of the metric. 
We simply have 

Dr = 2u~'^ o o u 

so for r > 0, the Dirac operator Dr is a differential operator in iy~^DiS^{Tp\G,'Ep). 
The normal operator AA(D$)(^, ^, r) of (see [19]) is obtained by replacing formally 

Vi, ^ i^, Vg ^ IT 

and then restricting to = 0. The result is a family of differential operators on the fibers of 
the boundary fibration (the x-circles) with coefficients in the spinor bundle, with parameters 
e e 5^ (e,r) G M2. 

(ZT \ IT 
9.-yj +C(y3)^. 

Definition 3.1. The operator is called fully elliptic \i J\f{D^){9,^^T) is invertible for all 
(0,e,r) G X IR2. 

If is fully elliptic, then by the results of [19] it has a parametrix inside the calculus of 
fibered cusp pseudo differential operators ^^^(X) modulo compact operators. 

Proof of Theorem ll.il According to the decomposition principle (see e.g. [3l Proposition 
1]), the essential spectrum of can be computed outside a compact subset of X, thus it is 
a superposition of the essential spectra of any self-adjoint extension of over each cuspidal 
end cp defined by vp < ep. We must make sure that such an extension exists (the Dirac 
operator on a manifold with boundary may not admit self-adjoint extensions, e.g. on R"*"). 
We may take for instance the Atiyah-Patodi-Singer boundary condition at the torus boundary 
{up = ep}. Special care is needed for the nullspace of the Dirac operator along the torus, 
we allow in the domain only harmonic spinors of the form (n, c(V3)ii) where u is in the 
i-eigenspace of ciVi). 

Since any T-parabolic subgroup P is conjugated by an element in the maximal compact 
subgroup K to the standard parabolic subgroup Pq, we see that the cusp corresponding to 
P is isometric to the "canonical" cusp P{)\G. Thus we can assume that we work with the 
canonical parabolic subgroup Pq. 

We have seen above that D^- belongs to z^~^Diff^(rp\G, Sp) near the cuspidal end. 

Lemma 3.2. The fibered cusp operator is fully elliptic on the cusp cp if and only if the 
spin structure is non-trivial along cp. 

Proof. We have computed above the normal operator M := Af{D^){0,^,T). Clearly, M is an 
elliptic self-adjoint operator on the circle in the variable x. Therefore M is invertible if and 
only if A^^ is. Now by the anti-commutation of the Clifford variables, 

^r' = e + ^, + {^^.-l?. 

This family of operators is independent of 6; it is strictly positive (hence invertible) for 
(^,r) / G M^. For ^ = T = 0, = -d'^, so ker{M) is made of those spinors which are 
constant in x in the trivialization V of the spinor bundle. For fixed 9, such spinors exist 
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globally on the x-circle if and only if the local lift V satisfies Vx=i = V^=o- Now the frame 
(^1) V2, Vs) is obtained from {E, A, H) by the transformation (13. 4p which is constant in x; thus 
the lift V exists globally around the cusp if and only if the lift of {E, A, H) exists globally 
around the cusp, which is by definition equivalent to the triviality of the spin structure around 
the cusp cp. □ 

If is fully elliptic, it follows from the above lemma and from the general theory of 
fibred cups operators that = 2v^^D^v has a parametrix Q G z^^J^ over the cusp cp, 
modulo compact operators. But Q itself is compact due to the decaying weight v] hence the 
self-adjoint operator "D^ has pure-point spectrum over the cusp. 

Conversely, assume that the spin structure is trivial along the cusp. The operator D^- = 
2i'~^D^v computed in (13. 5p has constant coefficients in x, thus it preserves the orthogonal 
decomposition into zero-modes and high-energy modes 

L\Tp\Gn{i^P < ep}, Sp) =: Hq © Ti' 

where Tio is the space of spinors constant in x in the trivialization V (we have seen above 
that V exists globally around the cusp if the spin structure is trivial along cp) and TC' its 
orthogonal complement. Over 7i', by the same argument as above, there exists a compact 
parametrix of Dr inside the fibered cusp calculus. Thus the essential spectrum of Dr over the 
cusp Cp only arises from the zero-modes, i.e., it is the essential spectrum of the operator 

acting in i^([0, e)xS^, Tip, dvdO) with any boundary condition at e which makes it self-adjoint. 
We conjugate this operator through the Hilbert space isometry 



We get the operator 



Ar = 2c{V^)vd, + ( ^ - C(F2)) 5,-^. 



This can be again decomposed according to the frequencies in the 9 variable. Note that 
although the local lift V may not exist globally, the ambiguity is locally constant so the 
operator idg is well-defined; moreover, it clearly commutes with A^. 

From (j3.4p . the frame (Vi,V2,V3) is obtained (after rescaling) from the frame {E,A,H) 
by a complete rotation around the E axis in time vr. Such a rotation is a generator of 
7ri(SO(3)) = Z/2Z. Hence V exists globally around the 9 circle if and only if the lift of 
[E, A, H) does not, i.e., if the spin structure is non-trivial along the fiber S'^/{ibl}. Otherwise, 
if the spin structure is trivial along the fiber S'^/{ibl}, then after time n the lift V changes 
sign. 

A spinor [V, a] is in the m-eigenspace of idg if and only if 
(3.6) a(i + 0) = e-™V(t). 

The resulting spinor should be vr-periodic (since we work on PSL(2,]R), we assumed that 
— 1 G r). We distinguish two cases: 

• The spin structure is nontrivial along the 5^/{ibl} fiber. Then V{tt) = V{0) so we 
want <7(7r) = <t(0). The eigenspinor equation (13. 6p gives m G 2Z; 
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• The spin structure is trivial along the fiber. Then V{7r) = —V{0) so we want 

(j{Tr) = — (t(0). The eigenspinor equation (13. 6p gives m £ 1 + 2Z. 
In both cases, the m-eigenspaces are 2-dimensional representation spaces for c{Vj), j = 1, 2, 3. 
Denote by Aj-^m the action of Ar on the m-eigenspace of idg. We get a 6-operator Ar^m (in 



the sense of Melrose) in L^([0,e),( 



Ar^rn = 2c{Vi)l>dy - C 



r 



r 

im . 

2 



The 6-normal operator of Ar^m is obtained by replacing I'di, with is where s is a complex pa- 
rameter. One knows from the general theory of 6-operators |20j that the following statements 
are equivalent: 

• A does not belong to the essential spectrum of Ar.m; i-e., ^r,' 

• M{Ar^rn){s) — A is invertible for all s G M. 
We use now the representation 



A is Fredholm; 



c{Vi) 







so that 



J\f{Ar,k){s) 



-2s 
im 



V3 

— -V2 
r 



-im{\ + r ^) 
2s 







-1 



1 + r" 




An easy computation shows that N{Ar^k){s 
A G 



A is invertible for all s G M exactly for 



r 0.1 
'2 ~ I^T-Kl + ^ 



2\ i —1 



-- + |m|(l +r2) 



2 f 



Thus the essential spectrum of Dr is the superposition of the complements of these intervals 
for each k and for each cusp Cp with trivial spin structure. 

In the sequel, we will assume that the spin structure is trivial along the 5"'^/{ibl} fiber, so 
the essential spectrum does not touch for small r > 0. In this case an alternate proof of 
Theorem II . II will follow from a computation using harmonic analysis over G (see Section [5]). 

4. Regularized trace and Geometric side 

In this section, we study the relation of certain regularized trace of the odd heat operator 
of Dr with the geometric side of the Selberg trace formula. 

To use the harmonic analysis over G, we need to fix the Haar measures over G and its 
subgroups. First the parametrizations in (13. Ih for Ao,Nq carry the Lebesgue measure du,dn 
from M to Aq, Nq. Now we fix Haar measures on K by vo\{K/Z) = 1 and on G by 



(4.1) / fig)dg 

Jg 

for /o G Gq{G) and = 



f{nauk)e ^dkdudn 



kp^Aokp, we put 



'G 

diag(e^, e~^). For ap^ '■= kp'^a^kp G A 

Hp{g) =u for g £ Nap^uK. 

The Iwasawa decomposition 7i = G / K = NA provides a parametrization of the geodesies 
nA ■ i G 7i to the infinity. The parameter value is given by the function Hp whose potential 
curves are A^-orbits (horocycles) on 7i. However, this parametrization is not adapted to F. 
To rectify this, we replace kp by gp = aupkp where e~"^ = vol(FAr\A^) where Tn := F n A^. 
For the new parameter 

Hp{g) + up = Hp^igpg), 
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then the value of this new parameter corresponds to the horocycle whose projection on T\H 
has length 1. 

For (/) G H := L'^{Z\K) = (e*™^ | m G 2Z) and s G C, we extend <^ to G by 

(j)s{nauk) = e^^'(t){k) for n G A'^o, k G K. 

These functions constitute the Hilbert space H<j = H in which the representation tTs induced 
from the parabolic subgroup Pq = NqAqZ acts as 

{■^s{g)4>s){x) = 4>s{xg). 

From now on, we assume that ^ = {Pi, . . . , P^} is a set of representatives for F-conjugacy 
classes of the cuspidal parabolic subgroups and that the spin structure over cp. for 1 < i < 
is trivial. We also assume that the representation p maps the generator k G t^i{X) to the 
identity 1, thus we consider only spin structures which are trivial along the S^/litll-fiber. 
For the representation space 1/ = of x = /? © we let be the invariant subspace of V 
under the action x\vp- Then 

\V if l<i<K* 
[{0} if K* + l<i<K 

For a cuspidal parabolic subgroup P, s C with 3f?(s) > 1 and G H , the Eisenstein 
series E{P, (p, s) is defined by 

E{P,(t>,s){g):= J2 x{l)U9Pl-^g)- 

Note that there is no Eisenstein series attached to Pj if + 1 < i < k. The Eisenstein series 
£'(P, (j), s) converges absolutely and locally uniformly for 3f?(s) > 1 and has the meromorphic 
extension over C. In particular, E[P, (j), s) is an automorphic form, that is, 

E{P,<p,s){jg)=x{l)E{P,(t>,s){g) for jeT,geG. 

For (p£ H(S) F'^'* with F^^* := ©Pe^pF^, we define 

(4.2) Eicl),s)=Y,E{P,pr''4>,s) 

where pr^ denotes the orthogonal projection onto , and 

E'^'{<t>,s){g) = {EP{4>,s){gp'g))p^^. 

Here, the constant term of E^{((),s) is defined by 

EP{ct>, s){g) := vol(r;v\iV)"' / pr^ s){ng) dn 
for N = Np. Then we have 

E''\(t),s) = (t>s + {C{s)4>)i^s 

where C(s) is the scattering operator acting on H © Y^^^, 

Now let us describe the spectral decomposition of L'^{T\G,x), 

L\T\G, x) = L\T\G, x)cus © L\r\G, x)rcs © L\T\G, x)ct. 

Here L^(r\G, x)cus is the space of the cusp forms in L'^(T\G,x), and decomposes into a 
Hilbert direct sum of closed irreducible G-invariant subspaces with finite multiplicities. The 
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residual part L'^{T\G, x)vcs is the direct sum of the constants and of finitely many copies of 
the complementary series representation of G such that some Eisenstein series has a pole at 
s G 1). These two spaces constitute the discrete part L^(r\G, x)dis- The continuous part 
L^(r\G', x)ct is isometric to 

f $ G L2(1 + iR, ^)^H V'^' I - ir) = Oil + iT)<^{l + ir) } 
(. 2 47r 2 2 2 i 

by 

(4.3) = —j E{^, - + ir) dr 

where ^ + iT) is defined as in (14. 2p with (p = ^ and s = ^ + ir. For / G L^{G), we define 
a representation on L^(r\G, x) by 

vr(/) := / f{9)7r{g)dg 
Jg 

where vr is the right translation action given by (^■K{g)(j)^{x) = 4>{xg) for (f) G L^(r\G, x)- 
We put TT^^^{f) = pr'^'^ o 7r(/), '/r'^*(/) = pr'^' o 7r(/) where pr*^'*^ , pr'^* denote the orthogonal 
projections onto L^(r\G, x)dis5 -^^(r\G, x)ct respectively. In particular, 7r'^*(/) intertwines 
with vrf* (/) := tti , .^(/) ® Idlest by J'^* given in (lOD . 

Since is a left invariant differential operator, there is a function ft^r G C°°(G, M(2, C)) 
such that 

ft,r{x~^y) = (5re-*^') (x, ?/) for a;, y G G. 

By the heat kernel estimates in which also holds for the generalized Laplacian with 
the form in (|2.3|) . we have 

M,did1hA^~'y)\\ < exp ( - 

where C is a positive constant and dc is the metric over G. (Note that we apply the method 
in [llj to a certain co-compact discrete subgroup V in G to obtain the above estimate.) This 
estimate implies that ft^r '■= i^ift,r) lies in the Harish-Chandra L^-Schwartz space C^(G)(C 
L\G)) defined by 

C\G) = {/ G G~(G) I \f{Dike,auke,D2)\ 

< Ge-I"l(l + \u\ + 1^1 + 02|)"", Vn G N,Z)i,Z)2 G g} 

where f{Dikoj^auko^D2) denotes the convolution Di*5kg_^ *5a„ *^ke2 * ^2 evaluated on /. Let 
us put 

K{t,x,y):= ft,r{^~^iy)x{l) = 5re"*^'(a;, 7y) x(7) for x,yGG, 

which is absolutely uniformly convergent on compact sets in G. For a F-cuspidal parabolic 
subgroup Pj = P = NAZ, we define the constant term of K{t, x, y) along P as follows, 

Kp{t,x,y)=vo\{TN\Ny^ [ V ftAx'^iny) xil) pr^ dn. 
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For ti G M, let ap{u) be the characteristic function of {x G G\ Hp{x) + up > u}, which 
projects on certain region Cpu C r\G for a large u. Then the truncation of K{x, x) is defined 
by 

AuK{t, X, x) := K{t,x,x) — ap{u)Kp{t,x,x), 
which is an automorphic form over r\G. 

Proposition 4.1. (Maass-Selberg Relation) For n ^ 0, we have 



(4.4) / tT{AuK{t,x,x)) dx 
Jr\G 

1 f'°° 1 1 

= u-J ^Tr(vrf;^^(/t,.))dT + Tr(vr'i^^(/,,,)) + -TV(C(-)vrfH/t,^^ 

- i Tr(C'(i - ^r)Cil + ^r)7r?lJkr)) dr. 

Proof. For a test function with compact support and i^T-finite condition, we can prove this 
proposition just following the argument in p. 58-60 of [14j . Then this can be generalized easily 
to our test function ft^r as in proof of the theorem 25 of [H]. The finiteness of the integrand 
of the integrals on the right hand side follows from Theorem II. li □ 



From Proposition 14.11 one can see that the first term on the right side of (14. 4p is blowing 
up as u ^ oo. Hence it is natural to remove this term in the following definition, 

(4.5) TV(Z?,e-*^^') :=Tr(7r'i^^(/i,,)) + ^Tr {C {hnf ift,r)) 



4 ' '2 2 



This regularized trace is the essentially same as the 5-trace of Melrose [20], and is related 
with the geometric side of the Selberg trace formula as we will see in Proposition 14. 2[ Denote 



Hr) = Qi+,Af)^ h{n) = Qnif) 



where Oi^j^(/) := Tr(7ri^j^(/)) for a principal series representation 7ri_(_j^, and Qnif) '■= 

Tr(7r„(/)) for a discrete series representation 7r„,. An operator J(s) over H = L?'{Z\K) is 
defined by 



(4.6) J(s)0™ = -= 



1 r(s)r(s-i)_ 



^ r(. + f)r(.-f) 



for the basis (t>m(ko) = E H where ka = f „ ^™ /> ). The following proposition 
^ ' Y — sm y cos r ' 

follows from Theorem 13 and Lemma 24 in 
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Proposition 4.2. (Selberg Trace Formula) 

(4.7) Tr (25, e-*^' ) =^^^i^^( Ttanh(7rr)V (T)(ir+ ^ (|n| - l)V(n) 

^ n=0{mod2) 

^ tr(x(7)) u, p ^, 



, Y 1"°° \ 

-2k*(— / ^P{l + 2iT)ht,r{r)dT + - Yl V( 

^ n=0(mod2) 

(4.8) +2{k-k')^ / V(r)dr 



r-oo 



k'' 1 r°° 1 1 

y V(0) - -p.v. J ^ Tr(J(- + ir)- V'(- + ir)vri ^^^(J^,,)) dr 



where ht^r{'T),ht^r{n) are defined for ft^r, the sum ^j^jgpj is given over the T-conjugacy 
class of hyperbolic elements 7 conjugate to au^, and ipi^) = r'(z)r(z)~^. 

5. Fourier TRANSFORMS ht^r{'T),ht^r{n) 

In this section, we compute ht^riT), ht^r{n) which are needed to analyze the right hand side 
of the Selberg trace formula. 

First, let us consider ht,r{T). For this, recall 

00 „ 

(5-1) ht,r{r) = Tr(7ri_^_.^(/t_r)) = X] / -^^'^^f^ (^i+ir(5')Cn, Cn) dg 

where {£,n}'^=i is the orthonormal basis of the representation space of vri^^^, which is given 
by the union of the following spaces indexed by m G Z for s = ^ + ir, 

H(s,m) := { 0^ G Hs I (j)s{nauke) = e'*'"e™^ for nauke G NqAqK}. 

Since is Z-invariant, the Fourier transform ht^r{'T) is nontrivial only if m is an even number. 
Recalling 

n _ ('^~^^\ ( 2X_ 

the problem is again reduced to the following lemma, which can be obtained applying the 
equalities in ()3.3p . 



Lemma 5.1. We have 



Zf = mf, X±f = -'-{m±2s)e^^''f /or/GH(s,m). 

The second equality in Lemma l5.ll implies that X± maps H(s,m) to H(s,m it 2). From 
these facts. 



!)^,m_2^ _ (r-^im - 2) + 2~^t -i{m - 1 - lir) 
i{m - 1 + 2ir) -r"^m + 2"^^ 



■>T,m-2 
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where I = and 4'r,m-2 £ H(^ + ir, m — 2), <j)r,m G H(^ + ir, m). Hence the action of 
on H(^ + ir, m — 2) ® H(^ + ir, m) is given by the roots of 

(5.2) a2 + rA + ^ - ^^^^^ = (m - 1)^ + At\ 



that is, 



A±(r,m) = ± (("^ - 1)^(1 +4r2)^/^ for m G 2Z,r G 



Therefore we have 
Lemma 5.2. 

V(t) = ei+,^(/t,,) = ^ (A+(r,m)e-*^+(^'"^)' + A_(r,m)e-*^-(-'-)'). 

Just repeating the above computation apphed to the Eisenstein series E{P, cpm, s), we can 
also prove Theorem ll.il 

Next we compute ht^r{n) for the discrete series representation 7r„. We review the discrete 
series representations of G = SL(2,R). For this it is more convenient to use the Lie group 
SU(1, 1) which is conjugate to SL(2,]R) within SL(2,C): 

Here 



SU(l.l) = {(f^ ^)| \a?-W? = l 

Then the holomorphic discrete series Tin {n G N) as a representation of SU(1, 1) acts on 
analytic functions on the disc by 



ay \-f3z + a_ 

and the norm, except for a constant factor, is given by 

Jj^l^J/(z)|2(l - |z|2)"-2dz forn>2 

supo<r<i /o^'' \ f{re'''^)\^ dO forn = 1 

The anti-holomorphic discrete series 7r„ (n G — N) as a representation of SU(1, 1) acts on 
analytic functions on the disc by 



with the same norm. 



Lemma 5.3. For the basis {2; }Arg{o}uN of the space of analytic functions on the disc, 
have 

X+z^ = {N + n)z^+\ X^z^ = -Nz^-\ 

Z z^ = {2N + n) z^ by the action of 7r„,, n G N, 



we 
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X+z^ = -iV2^+i, = (iV + 

Z = -{2N + n)z^ by the action o/7r„, n G -N. 

Proof. By elementary computations, we can see that the subgroups generating K, H, A are 
transformed as follows: 

cos 6* sm9\ fe'" 



sin 6* cos \0 e"*^ 

'e* \ / cosht isinht^ 

e~*y isinht cosht 

/cosht sinht\ /cosht sinht^ 

ysinht coshty ysinht cosht^ 

where the matrices on the right side denote elements in SU(1,1). To see the action of K 
under 7r„ for n G N, let us consider 

(5.3) vrjf = e(2^+")^^.^, 







which implies 



d 



dO 

In a similar way, we can show that the action vr^ for n Gl^hj H,A are given by 

Hz^ = i{N + n)z^+^ + iNz^-\ Az^ = {N + n)z^+^ - Nz^~\ 

These imply the equalities for 7r„ for n G N. The case for 7r„ for n G — N can be obtained by 
taking the complex conjugates of equalities for the action of 7r„ for n G N. □ 

Now we consider the action of Dj- under 7r„ for re G N. From (15. 3p . we can see that are 
the -fC-type vectors of weight m if rre = 2N + re. By Proposition 15.31 over (a, /3) for X-type 
(m — 2), m vectors a, /9 in the representation space of 7r„ the Dirac operator Dr acts by 



2r j^'^ ^ \^—{n + m — 2) —r 

noting N = {m — re)/2. We have two cases: First, if (3 is not the minimal X-type for 7r.„, that 
is, m > re, as in the derivation of ()5.2p . we can obtain the corresponding eigenvalue equation 



(rre — 1)^ 



X^ + rX + — - ^ ^ = (m - ly - (re - 1) 

4 



Hence 

A±(re, rei) = ± ((m - 1)^(1 + r"^) - (re - 1)^)^^^ for m = re + 2, re + 4, . . .. 

Second, if (3 is the minimal if-type for 7r„, that is, ET-type m = n vector, then a is just trivial. 
Hence, the eigenvalue is given by 

, , , r 1 - re 
A(re) = -- + --. 

Repeating the same procedure as in the case of 7r„ for re G N, we can obtain the same 
eigenvalues A-i-(re, rre), A(re) for 7r„ for re G — N. In our case, re should be an even number since 
r contains —Id. Combining all the facts derived in the above, we have 
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Lemma 5.4. For n G 2N, h{n) = Qn{f)j we have 

htAn) = Kri-n) = (A(?i)e-*^W' 

+ (A+(n, m)e-*^+ +A_(n,m)e-*^- 

men+2N 



where \{n) = -§ + 1^, A±(n, m) = -§ ± ((m - 1)2(1 + r'^) - (n - 1)2) 

6. Eta function of Dr: Principal series part 
Now we study the eta function defined by 



2\i/2 



1 1 

r,{Dr, s) := -— ^ / t^Tr(l),e-*^^) dt 
1 JO 



for 3f?(s) ^ and r near 0. First let us recall that the bottom of each branch of continuous 
spectrum of goes to oo as r — > by Theorem II. 1[ Hence for a small r > 0, Tr(Z)re~*^'') 
decays exponentially as t — > oo. To analyze Tr(Z)re~*'^^) in more detail, we apply Proposition 

14.21 which relates Tr(L',.e~*^^) with the geometric side. Note that this geometric side can be 
decomposed into two parts: 

Trp(L»^e~*^') =Tr(D^e-*^') - Trd(-Dr-e"*-^') , 

Trd(25.e-*^?) =^^^i|^ {\n\-l)ht,r{n)-^' Y Kr{n) 

n=0(mod2) ?i=0(mod2) 

and accordingly we also decompose the eta function r]{Dr, s) into 

viDr, s) = r]p{Dr, s) + r/d(-Dr, s). 

The principal part of the eta function r]p{Dr, s) is studied in this section and the other part 
rid{Dr, s) will be considered in the next section. 
We start with the following lemma. 

Lemma 6.1. Putting I{m, r, r) = [{m - 1)^(1 + r~2) + At^)"^ , 
ht,r{T) = exp ( - — t - 4r2t) 

mG2Z fc=0 ^ ' ^ ^ 



where the term ^(2fc-i)! /''^ k = vanishes and for t G [0, 1] and r G (0, 1] the following 
estimate holds, 

(6.1) |/if,r.(T)| < 2rexp(- — t-4r2t) 

• Y e-(™-i)'(^+^'"')*(l + /(m,r,r)2 + e^('"'^'^)'''* 

mG2Z 
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Proof. We can rewrite ht^r{T) as follows, 

f"^ ■ . O.N NT^ _(m-l)2(l+r-2)t 



(6.2) ht^rir) = exp ( - -t - AtH) ^ e 

m.e2Z 

. ^ _ I (^^I{m,r,T)rt _|_ ^-I{m,r,T)rt^ _|_ j^^^ ^-j |'g/(»n,r,r)ri _ ^-I(m,r,T)rt^ ^ ^ 

Now the Taylor expansion of g^^'"'^''^)^* it e~^(™'''''^)''* gives us the claimed form of the first 
equality. To prove the second estimate, we note that 



fe=0 

„2+ °° l^+\2k~l ^2 



r^t irtr^^^ rH 

r + rt (2 - — ) /(m, r, rf + J] ^_ (2 - ^) /(m, r, r) 



2k 



For t G [0, 1] and r G (0, 1], observe that 

from which it is easy to derive the estimate. □ 

Our first task in this section is to get the asymptotic expansion of Trp(Z)f.e~*'^^) as i ^ 0. 
By Lemma l6. 11 we can rewrite the first part of Trp(Dre~*'^^) as follows, 

/oo J.2 
Ttanh(7rT)/it,,.(r)(ir = ^ exp (- —t - (m - 1)^(1 + r'^)*) 

mG2Z 
oo 

k=0 k=p+q 

/oo 
Ttanh(7rr) (2T)2«e-^"'* dr 
-oo 

where ak,p,q{r),bk,p,q{r) (6o,p,g(r) = 0) depend only on r and are of order 0(r) for small r > 0. 
The integral in the last line can be handled as follows, 

/oo /"OO 
rtanh(7rT) (2r)2'?e-^^'* dr =(-l)''5<* / r tanh(7rT) e"^^"* dr 
-oo ./ — oo 

/"OO 

={-'^yd^ / tanh(^V^)e-^*^ dx 







Hence we have 



/■oo 

(6.4) / Ttanh(^r)(2T)29e-^^'*dT ~ J]]afct-''-i+^ as t^O 
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where are independent of r. Now we note the foUowing equahties for the first and the 
third factors on the right hand side of (j6.3p . 



(6.5) Y.^^- ^'^^"^^ + ''^P ( - ("^ - 1)^(1 + ^"^)*) 

mG2Z 

= (-iraf exp ( - 4(m - 1)2(1 + r-')t) 
=(-l)Paf y (-1)"- , ^ = exp ( - -7^^^^^) 



(_l)Paff^£^+ y (-1)- ^ ^ =exp 



4(l+r-2)t^ 

where the second equahty is the Poisson summation formula. Note that the terms for nonzero 
m in the last line of ()6.5p decays exponentially as t — > 0, so that small time asymptotics is 
given by the first term in the last line of (j6.5p . Therefore we have 



(6.6) ^ (m - 1)2P(1 +r~2)P exp (- (m - 1)2(1 + r~2)i) ^ a(r)t-5-P as t^O 



where a{r) depends only on r and 0(r) for small r > 0. 

By (j6.3p and the asymptotic expansions in (|6.4p , (|6.6p , taking care of r-dependence of their 
coefficients, we can conclude 

/OO °° 3 

rtanh(7rT)/it,,.(r)dr ~ ^afe(r)t~2+^' as i^O 
fc=o 

where afc(r) depends only on r and is of 0{r'^) for small r > 0. 

Now for the second part of Trp(Z)re~*'^'-), we repeat the above process and noting 

/OO /"CXD 
cos(n^r) (2r)2'?e-^"'* dr = (-l)''^^^ / cos(n^r) e"^"'* (ir 
-OO J —OO 



(-l)X(^exp(-l) 



we can see that this term does not contribute to the asymptotics as i ^ 0. 

OO 



To deal with the third part of TipiDrC ^^^), we recall 



(6.8) V(l + ^) ~ log^+ ^ -^^2; as z ^ 00 

k=l 



-2k 



where i?2fc is the Bernoulli's number, which implies 

/OO 
iP{l + 2iT) (2T)29e-^"'*dr 
-00 

00 

~ 6t~^~''logi +c +^afct~'?"^+'^' as t^O 



k=0 
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where the constant c vanishes unless q = 0. Proceeding as before and using (|6.9p . 

/oo °° fe 

^p{l + 2iT)ht,r{T) (ir ~ ^ afc(r) ^"^+2 + fe^(r) r^+^ \ogt as t ^ 
fc=o 

where ak{r), hk{r) depend only on r and is of O(r^) for small r > 0. 

For the fourth part of Trp(Z)re~*^''), it is also easy to get the following asymptotic expan- 
sion 

/oo ^ 
ht,r{T)dT ^ak{r)t-^+'' as t^O 

where afc(r) depends only on r and is of O(r^) for small r > 0. 

Now it is easy to see that the next term ^/i(^,.(0) contributes to the small time asymptotics 

by (|6.7p with the first term ai{r)t~2. 

By ()4.6p . the integrand of the last integral of the geometric side can be expressed by 

1 1 ~|~ TTl 1 — 771/ 

(6.12) + -^(^— + ir) - + 
Using the following formulas about ip{z), 

(6.13) i>{z + l) = - + ip{z), V'(z)+^(z + ^) = 2(V(2z)-log2), 
the terms in (j6.12p can be rewritten as 

2(V'(1 + it) - ipn + 2iT)) - — + 2 log 2 

ir 

1 3 m — 1 



.l + 4r2 32 + 4r2 (m-l)2 + 4r2y 

The terms in the first line gives us the asymptotics as (|6.1Up . The terms in the second line also 
can be handled as in a similar way and we can show that these term gives us the asymptotics 



(6.14) ^ak{r)t-^ as t^O 



ik{r)t 

k=0 

2^ 



where Ofc(r) depends only on r and is of 0(r ) for small r > 0. Combining (|6.7p . (|6.10p . (|6.14p 
and facts derived in the above, we obtain 

Theorem 6.2. The small time asymptotics is given by 

oo 

(6.15) Trp(D,.e~*-^') ~ ^afc(r)t^ +6;.(r)t-i+'= logt as t^O 

k=0 

where ak{r),bk{r) depend only on r and is of 0{r'^) for small r > 0. In particular, if = 0, 
it has the following simple form, 

oo 

Trp(L>^e"*-°') ~ ^afe(r)t-^ as t ^ 0. 

k=0 

This theorem also immediately implies 
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Theorem 6.3. For a sufficiently small r > 0, the function r]p{Dr,s) defined for ^ 
has the meromorphic extension over C and may have a double pole at s = 1 and simple 
poles at — N U {0,2}. In particular, if = 0, r]p{Dr,s) may have only the simple poles at 
-NU {0,1,2}. 

In the view of Theorem 16.31 it is natural to define the principal part of the eta invariant of 
Dr by 

Vp{Dr) ■■= (r]p{Dr,s) - — ) 

where rg is the residue of the simple pole of r]p{Dr,s) at s = 0. Now let us consider the 
adiabatic limit of r]p{Dr) as r — > 0. For this, we need 

Proposition 6.4. Asr^O, Trp(A.e-*^'-) converges toOfort e (0,oo), andtlTrp{Dre-^^r^ 
converges to uniformly for t E [0, 1] . 

Proof. From the expression of ht^r{T) in (|6.2|) . we can see 

2 

\htA^)\ < C exp ( - - Arh) ^-c{m-lf{l+r-^)t ^^^^y ^ ^ Q 

me2Z 

where C, c are the positive constants that do not depend on r, r. Hence, the integral 




T tanh(7rr) ht^r{T) dr 



vanishes as r — > by the dominated convergence theorem. The same argument holds for other 
terms defining Trp(L're~*^'") . Hence Trp(Df.e~*'^'') converges to as r ^ 0. The uniform 
convergence of t2Trp(DrC~*^^) follows from the following estimate 

< Cr^ for t G [0,1], 

which also follows easily from ()6.ip and ()6.5p . □ 

Now we have 
Theorem 6.5. 

limr7p(A.) = 0. 

Proof. Let us consider 

77p(A.) =^ / t^5Trp(n,e-*^') dt 

For the integration over [l,oo), recalling that Trp(Z)re~*'^^) is exponentially decaying as 
t — > oo, it is easy to see that this part vanishes as r ^ by Proposition 16.41 and the dominated 
convergence theorem. By (I6.15P the meromorphic extension of the integral ■ dt has the 



(6.16) 



[Dre 



-tDl 
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following form for JR(s) > — e with small e > 0, 



(6.17) 



t—TTp{Dre 



-tDl 



)dt 



2an 2ai 
— ^ + ■ 



46o 



+ 



s - 1 

203 



Abi 



+ 



+ 



2ao 



t—Til{Dre~^^-) dt, 



s + 1 (s + l)2 

where 

TV;(L»,e- 

By Theorem [621 all t^ie coefficients 00,01,02,03,60)^1 (as function of variable r) vanish as 
r — > 0. Hence putting s = except the term — , we can see that — oq — 2ai — 4bi + 203 — 46i 
vanishes as r — > 0. For the last integral with s = also vanishes as r — > since 



) := Trp(L».^e"*^^) - oot"^ - ait~^ - bot'^logt- 02 1"^ - 03 - 61 log t. 



t-5Tr;(L»^e-*^') <Cr^ for te[0,l], 



which follows from (|6.16p and the coefficients oo, oi, 02, 03, 60, &i vanish as order of r^. This 
completes the proof. 

□ 



7. Eta function of Dr: Discrete series part 

In this section we study the discrete part of the eta function r]d{Dr,s) when r > is 
sufficiently small. 

First, from LemmaEHl let us recall that ht^rif^) is given by A(n)'s and A-|-(n, m)'s and we 
decompose Trj (-DrC^*^'') into the corresponding two parts. Then we also have 

7]A{Dr,s)=ri\{Dr,s)+7]l{Dr,s) ioT 3f?(s) > 

where 



r^l{Dr,s) = T' {2g-2 + K)(-y ^^^^ H )+rVfV ^ - 

^ ^(2fc-l + 4)«^ V^(2A;-l + 2j)^ 

oo 

{Dr,s) = {2g-2 + K)(2y{2k-l) ^ A+(2A:, 2^)"'^ - A_(2A;, 2^)"") 

oo 

2^ ^ A+(2A:,2£)~^ - A_(2A;,2^)-"). 



fc=i ^Gfc^ 

oo 



fc=i^efc+N 
Here we used the fact 

vol(r\G) = 27r (2c; - 2 + k) 

where the volume of r\G is given w.r.t. the Haar measure in (j4.ip (recall that the volume of 
the circle K/Z is normalized to be 1). 

Now we investigate r]^{Dr,s). Let us recall the Hurwitz zeta function 



C(s,o) =^(/c + o)- 



k=0 
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which has a meromorphic extension to the whole C with a simple pole at s = 1. If we set 

oo 

Co(s,a) = J^(2A:-l + a)-^ 



fc=i 

then 



Co{s,a) = as,a)-2~X{s,^). 
By these definitions, for 3f?(s) S> 0, 

( 2 2 2 \ 2 

Cois - 1> y) - yCo(s, y)J + 2K'rXo{s, y ). 

The right hand side gives the meromorphic extension of ri^{Dr, s) over C with the simple poles 
at s = 1, 2. We can also see that r]l{Dr,s) is regular at s = from this equality. Recalling 

C(0,a) = ^-a, Ci-l,a) = -Ua'^-a + ^ 



we can see that 



Using these, we obtain 

vl{Dr,0) = (2 - 2g - Q + - . 
Summarizing all these for r]^(Dr,s), we have 

Proposition 7.1. For a sufficiently small r > 0, the function r]\{Dy.,s) define for 5R(s) ^ 
has the meromorphic extension over C and has the simple poles at s = 1,2. The following 
equality holds, 

(7.1) limnl{Dr,0) = U2-2g-K). 

r— >0 

To get the meromorphic extension of r]'^{Dr, s) over C, we rewrite this as follows, 
r]l{Dr, s) = 2{2g-2 + K) r'fr{s) - 2^'r'gris). 

Here 

2 2 
fris)= ^ (2k-l)[{qrik,i)-^-)-'-{qr{kJ) + ^-)- 

e>k>i 

2 2 
9ris)= Yl (9r(fe,^)-y)"'-(gr(A:,£) + y)-' 

e>k>i 

where 

= {{2e-l)\l + r^)-r\2k-lfy. 
Now we put = X^f>fc>i(2A; — l)(7r.(A;, ^)~'^ which can be written as 

K(s) = Y.(2k - 1)'- E(2' - - 

fc>l i>k ^ J \ J 
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From this and the above analysis of Coi^, 0), we can see that hr{s) is holomorphic for > 2. 
For the meromorphic extension of over C, we use the identity = exp(s log(l + (o— 1))) 
to get 

1 + 

(2A;- 1)2 " (2£- 1)2 

_ _ g/ l+r2 r2 _ , 5/ 1 + 7-2 r2 _ -|\2 

2^(2fc-l)2 (2^-1)2 ^^4^(2fc-l)2 (2^-1)2 ;+■••■ 

From this, we can see that hr{s) has the meromorphic extension over C and may have the 
simple poles at s = 2, 1,0, —1, . . . with the residues which are continuous w.r.t. r. Using the 
following equality 

Ms) = (^rhhris + 1) + r^'±±^^^±^hAs + 3) + r'^e{s, r) 

where 6{s,r) is regular at s = and is continuous at r = 0, we can conclude that /r(s) is 
regular at s = and the limit of /r(0) as r — > is trivial. In a similar way, we can see that 
the same conclusion is true for gr{s). By all these facts, we have 

Proposition 7.2. For a sufficiently small r > 0, the function i]'^{Dr, s) defined for 3f?(s) 3> 
has the meromorphic extension over C and may have the simple poles at s = — NU {1}. The 
following equality holds, 

(7.2) lim r]l{Dr, 0) =0. 

By Proposition 17. H 17.21 we can define 

r]iiDr) := m{Dr, s)\^^^ = vliDr, 0) + 7jl{Dr,0) 

and 

Theorem 7.3. For a sufficiently small r > 0, the discrete part of the eta function i]d{Dr,s) 
has the meromorphic extension over C and may have the simple poles at — NU {1,2}. The 
following equality holds, 

llmvdiDr) = ]:i2-2g-K). 
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